Predictive Information

نویسندگان

  • William Bialek
  • Naftali Tishby
چکیده

Observations on the past provide some hints about what will happen in the future, and this can be quantified using information theory. The “predictive information” defined in this way has connections to measures of complexity that have been proposed both in the study of dynamical systems and in mathematical statistics. In particular, the predictive information diverges when the observed data stream allows us to learn an increasingly precise model for the dynamics that generate the data, and the structure of this divergence measures the complexity of the model. We argue that divergent contributions to the predictive information provide the only measure of complexity or richness that is consistent with certain plausible requirements.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Big Data Analytics and Now-casting: A Comprehensive Model for Eventuality of Forecasting and Predictive Policies of Policy-making Institutions

The ability of now-casting and eventuality is the most crucial and vital achievement of big data analytics in the area of policy-making. To recognize the trends and to render a real image of the current condition and alarming immediate indicators, the significance and the specific positions of big data in policy-making are undeniable. Moreover, the requirement for policy-making institutions to ...

متن کامل

An Efficient Predictive Model for Probability of Genetic Diseases Transmission Using a Combined Model

In this article, a new combined approach of a decision tree and clustering is presented to predict the transmission of genetic diseases. In this article, the performance of these algorithms is compared for more accurate prediction of disease transmission under the same condition and based on a series of measures like the positive predictive value, negative predictive value, accuracy, sensitivit...

متن کامل

مدل ترکیبی تحلیل مؤلفه اصلی احتمالاتی بانظارت در چارچوب کاهش بعد بدون اتلاف برای شناسایی چهره

In this paper, we first proposed the supervised version of probabilistic principal component analysis mixture model. Then, we consider a learning predictive model with projection penalties, as an approach for dimensionality reduction without loss of information for face recognition. In the proposed method, first a local linear underlying manifold of data samples is obtained using the supervised...

متن کامل

Constrained Model Predictive Control of Low-power Industrial Gas Turbine

Nowadays, extensive research has been conducted for gas turbine engines control due to growing importance of gas turbine engines for different industries and the need to design a suitable control system for a gas turbine as the heart of the industry. In order to design gas turbine control system, various control variables can be used, but in the meantime, fuel flow inserting into combustion cha...

متن کامل

Predictive Modeling of Phenylpiperazine Derivatives for Renin Inhibition.

The renin–angiotensin–aldosterone system is the well established endocrine system having significant role in preserving hemodynamic stability. Renin is secreted from the juxtaglomerular cells of the kidney. Phenylpiperazine derivatives have been reported as human renin inhibitor. To perform predictive QSAR modeling for 27 phenylpiperazine derivatives as renin enzyme inhibitors. The IC50 values ...

متن کامل

Provide a Predictive Model to Identify People with Diabetes Using the Decision Tree

Background: Today, in most hospitals in Iran, there is an extensive database of patient characteristics that includes a large amount of information related to medical, family and medical records. Finding a knowledge model of this information can help to predict the performance of the medical system and improve educational processes. Methods: Data mining techniques are analytical tools that are...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1999